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Abstract. Let T be an n x n random matrix, such that each diagonal entry Ti^i is a 
continuous random variable, independent from all the other entries of T. Then for every 
n X n matrix A and every t > 



|det(A + r)|i/" < t 



< 2bnt, 



where 6 > is a uniform upper bound on the densities of T^^ 



1. INTRODUCTION 

In this note we are interested in the following question: Given an n x n random matrix 
T, what is the probability that T is invertible, or at least "close" to being invertible? One 
natural way to measure this property is to estimate the following small ball probability 



P 



Sn{T) < t 



where s„(T) is the smallest singular value of T, 



Sn{T) 



def 



inf 

|a;||2=l 



Tx\ 



\T- 



In the case when the entries of T are i.i.d random variables with appropriate moment as- 
sumption, the problem was studied in P [HI [111 [151 IE]- We also refer the reader to the 
survey [10]. In particular, in [12] it is shown that if the entries of T are i.i.d subgaussian 
random variables, then 



P 



Sn{T) < t < C^t + e 



'1.11 



where c, C depend on the moment of the entries. 

Several cases of dependent entries have also been studied. A bound similar to (11. ip for 
the case when the rows are independent log-concave random vectors was obtained in [T[ [2] . 
Another case of dependent entries is when the matrix is symmetric, which was studied in 
[3 [6l [3, [HI [HI [19] . In particular, in [5] it is shown that if the above diagonal entries of T 
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are continuous and satisfy certain regularity conditions, namely that the entries are i.i.d 
subgaussian and satisfy certain smoothness conditions, then 



P 



Sn{T) < t < C^t. 



The regularity assumptions were completely removed in [6] at the cost of a t?,^/^ (independence 
of the entries in the non-symmetric part is still needed). On the other hand, in the discrete 
case, the result of [19] shows that if T is, say, symmetric whose above diagonal entries are 
i.i.d Bernoulli random variables, then 



P 



where c is an absolute constant. 



A more general case is the so called Smooth Analysis of random matrices, where now we 
replace the matrix T by A + T, where A being an arbitrary deterministic matrix. The first 
result in this direction can be found in [13], where it is shown that if T is a random matrix 
with i.i.d standard normal entries, then 



P 



Sn{A + T) <t < C^t. 



1.2) 



Further development in this direction can be found in [18], where estimates similar to (11. 2p 
are given in the case when T is a Bernoulli random matrix, and in [Gj El |9], where T is 
symmetric. 

An alternative way to measure the invertibility of a random matrix T is to estimate det(T), 
which was studied in [H|lll [16] (when the entries are discrete distributions). Here we show 
that if the diagonal entries are independent continuous random variables, we can easily get 
a small ball estimate for det(v4 + T), where A being an arbitrary deterministic matrix. 

Theorem 1.1. Let T be an n x n random matrix, such that each diagonal entry Xi^i is a 
continuos random variable, independent from all the other entries ofT. Then for every nxn 
matrix A and every t > 



det{A + T)\ 



l/n 



< t 



< 2bnt, 



where b > is a uniform upper bound on the densities ofTi^i. 

We remark that the proof works if we replace the determinant by the permanent of the 
matrix (see [3] for the difference between the notions). 



Now, we use Theorem 11.11 to get a small ball estimate on the norm and smallest singular 
value of a random matrix. 
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Corollary 1.2. Let T be a random matrix as in Theorem \l.l[ Then 



P 



irii < t 



< 2bnt, 



and 



P 



n n— 1 1 

SniT)<t < (2&)^ (E||T||)~t^ 



;i.3) 



;i-4) 



Corollary 11.21 can be applied to the case when the random matrix T is symmetric, under 
very weak assumptions on the distributions and the moments of the entries and under no 
independence assumptions on the above diagonal entries. Note that in this case when T is 
symmetric, we have 

||T|| = sup {Tx,x) > max \Ti^i\. 



2=1 



l<j<n 



Thus, in this case we get a far better small ball estimate for the norm 



P 



ITII < t 



< {2bty 



Finally, in Section [3] we show that in the case of 2 x 2 matrices, we use an ad-hoc argument 
to obtain a better bound than the one obtained in Theorem II. 1[ We do not know what is 
the right order when the dimension is higher. 



2. Proof of Theorem 11.11 

Before we give the proof of Theorem 11.11 we fix some notation. First, let M = A + T, and 
let Mfc be the matrix M after erasing the last n — k rows and last n — k columns. Also, let 
Qk be the a-algebra generated by the entries of Mk except Mk^k- 



Proof of Theorem We have 

I det(Mfc)| = |Mfc,fcdet(Mfc_i) + 
where fk is measurable with respect to Vlk- We also have 



P 



det(Mfc)| < Sk 



< P 



det(Mfc)| < £a: A I det(Mfc_i)| > Sk-i + P | det(Mfc_i)| < Sk-i 
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Now, 



det(Mfe)| < A I det(Tfc_i| > Sk-i 



E 



P 



\Mk,kdet{Mk-i) + fk\ <ek 



1 



{|det(Mfe_i)l>efe_i} 



< supP 



\Mk,k + l\ < 



< 2b- 



£fc-i 



where the last inequahty follows from the fact for a continuous random variable X we always 
have 



supP 

7GK 



|X + 7| < t 

where 6 > is an upper bound on the density of X. 
Thus, we get 

pf|det(Mfc)| < < 21 



< 26t 



(2.1) 



Also, note that 



Therefore, 



P 



det(Mfc)| <ek^ 
det(Mi)| < El 



< 2b^ + P 



P 



det(Mfc_i)| <£fc_i 

7^1,1 + <£i 



cm 



p 



det(M„)| <e. 



< 2b 



k=2 



£k 

^k-l 



Choosing Ej = t-'/", the result follows. 



Corollary 11.21 now follows immediately. 



□ 



Proof of Corollary Let Si{T) > ■ ■ ■ > s„(T) be the singular values of T. We have 

n 

\det{T)\ = l[s.{T)<{s,{T)r. 

Thus, by Theorem II. H 



i=l 



P 

which proves (II. 3p . 

To prove ( II. 4p . note that 



si{T) <t <F |det(T)|^/" < t 



< 2bnt, 



det(T)| = n^*(^) < s^iTY-^SniT) < \\Tr-^Sn{T). 



(2.2) 



i=l 



Thus, 



P 



Sn{T) < t 



< P 



Sn{T) <tA\\T\\ <I3 



+ p 



|T|| > (5 



For the first term, we have by fl2.2p and Theorem ll.H 



P 



Sn{T) <tA||T|| </3 



< P 



det(T) < (3''-H < 2hp—t 



.l/n 



Also, 



P 



\T\\ > /3 



< 



Eiin 



Thus, by ([23D and (El, 



P 



Sn{T) < t 



< 2h(3—t 



E||T| 



Optimizing over /3 gives (11. 4p . 



(2.3) 



(2.4) 



□ 



3. The case of 2 x 2 matrices 

As discussed in the introduction, we show that for 2 x 2 matrices the small ball estimate on 
the determinant obtained in Theorem 11.11 is not sharp. To do that, we use the well known 
fact that if X and Y are continuous random variables with joint density function /x,y(", ■) 
then X ■ Y has a density function which is given by 

z\ dw 
wJ |w| ' 

where fx, fv are the density functions of X, Y, respectively. 
We thus have the following. 



fx-Y{z) = / fx,Y (w, 
J —oo 



Proposition 3.1. Assume that X andY are independent continuous random variables, with 
fx ^b, fy < b. Then fx-Y, the density function of X - Y satisfies 



fxAz) < 



2b + 2b'^\\og{\z\ 



2b 



\z\ < 1, 
\z\ > 1. 



Proof. Assume first that \z\ < 1. Write 

fx-Y{z) = [ fx,Y (w, —) 



( z \ dw f „ / z\ dw f „ / z \ dw , ^ 

fx,Y[w,-) — + fxy[w,-) — + fxyiw,-)— 3.1 

|«,|<|^| ^ \W\ J\z\<\vj\<l ^ \W\ i|^|>i V w) \w\ 



5 



Since X and Y are independent, /x,y (a;, y) = fx{x) ■ fviy)- We estimate each term of (13. ip 
separately. Assume first that |2;| < 1 

/ Mu,).h-{r)p.<i! fy(^)p-.=i! fy(y&.<i (3^2) 

J\w\<\z\ \W\ J\w\<\z\ \W\ J\y\>^ \y\ 

f fx{w)-fy(-)p\<b' [ = 2b'\\og{\z\)\ (3.3) 

J|^|<|«,|<i ^w;/ \w\ J\z\<\n,\<i m 

/ fxiw)- fy (-)--< b f^(nj)--<b. 3.4 

j|^i>i fI J\w\>i m 

Plugging (O, (D and (jS^D into §A^, the result follows for j^] < 1. 
Now, if \z\ > 1, then write 

fx-Y{z) = [ fx,Y (w,—)p^ 

J-oo ^ WJ \w\ 

= / /.W-/k(^);^+/ /.vH ■ /v (^) I^. (3.5) 

J\w\<\z\ \W\ J\^>\z\ ^WJ \W\ 

For the first term, we have 

/ Sx{^')-h-{-)p-<b! fy{y)^^.<i. (3.6) 

J\w\<\z\ ^wJ \w\ J\y\y^ \y\ 

And, for the second, by (13. 4p 

/ h(«)-fynp-<! h(^)-fynp-,<»- (3.7) 

J\w\>\z\ ^WJ \W\ J\^\>i \WJ \W\ 

Plugging (13.61) and (13.70 into (13. 5p . the result follows. □ 



Using Proposition 13.11 we immediately obtain the following: 

Corollary 3.1. Let X and Y be independent continuous random variables. Then for every 
t G (0, 1) and every 7 G M, 

F\X-Y + -f\<t <4bt + 4bh{l + \\ogt\), 

where b > is a uniform upper bound on their densities. 

Proof. Note that the function 

g{z) = (26 + 26^1 log(|2;|)|) l||,|<i| + 2W||,|>i} 

satisfies fi^d^zil) < (7(1-221) whenever \zi\ > \z2\. Thus, we have for every 7 G M, t G (0, 1), 

/ g{z)dz< g{z)dz= {2b + 2b'^\\og{\z\)\) dz = 4bt + 4bH{l + \ log t\). 

J'y-t J-t J-t 



Thus, by Proposition 13.11 we have 



|X-F-7| < t 









■y+t 



□ 

We also obtain the following corollary. 

Corollary 3.2. LetT = {Tij}ij<2 be a random matrix such thatTii andT2^2 ore continuous 
random variables, each independent of all the other entries of T . Then for every t G (0, 1) 

P I det(T)|i/2 < t < Aht^ + 46^^2(1 + 2| logt|), 

where b > is a uniform upper bound on the densities ofTi^i, T2,2- 

Proof. We have, 



P 



det(T)| < t 



= P 
= E 
< supP 



^1,1 ■ 2^2,2 — ^1,2 ■ ^2,1 1 ^ t 

Tl^l ■ r2,2 — Ti^2 ■ ^2,1 1 < t Ti_i, T2,2 



■ r2,2 + 7l < ^ 

< Abt + 4bH{l + |logt|), 
where in the last inequality we used Corollary 13.11 Replacing t by t^, the result follows. □ 

Acknowledgements. We thank Alexander Litvak and Nicole Tomczak-Jaegermann for 
helpful discussions and comments. 



References 

[1] Adamczak, R.; Guedon, O.; Litvak, A.; Pajor, A.; Tomczak-Jaegermann, N. Smallest singular value 

of random matrices with independent columns, C. R. Math. Acad. Sci. Paris, 346 (2008), 853-856. 
[2] Condition number of a square matrix with i.i.d. columns drawn from a convex body. Proc. 

Amer. Math. Soc. 140 (2012), no. 3, 987-998. 
[3] Bourgain, J.; Vu, V.; Wood, P. M. On the singularity probability of discrete random matrices. J. 

Funct. Anal. 258 (2010), no. 2, 559-603. 
[4] Costello, K.; Vu, V. Concentration of random determinants and permanent estimators. SIAM J. 

Discrete Math. 23 (2009), no. 3, 1356-1371. 
[5] Erdos, L.; Schlein, B.; Yau, H. T. Wegner estimate and level repulsion for Wigner random matrices. 

Int. Math. Res. Not. IMRN 2010, no. 3, 436-479. 
[6] Farrell B.; Vershynin R. Smoothed analysis of symmetric random matrices with continuous distri- 



butions. Preprint available at http://arxiv.org/abs/1212.3531 2012 



7 



[9 

[lo; 
[11 

[12 

[13: 

[14 
[15 
[16 

[ir 

[is: 

[19 



Maltsev, A.; Schlein, B. A Wegner estimate for Wigner matrices. Entropy and the quantum II, 
145-160, Contemp. Math., 552, Amer. Math. Sec, Providence, RI, 2011. 

Nguyen, H. Inverse Littlewood-Offord problems and the singularity of random symmetric matrices. 
Duke Math. J. 161 (2012), no. 4, 545-586. 

On the least singular value of random symmetric matrices. Electron. J. Probab., 17, 2012, 

no. 53, 1-19. 

Nguyen, H.; Vu, V. Small ball probability, inverse theorems, and applications. Preprint available at 
http : //arxivl org/abs/1301 . 0019, 2013. 

Rudelson, M. Invertibility of random matrices: norm of the inverse. Ann. of Math. (2) 168 (2008), 
no. 2, 575-600. 

Rudelson, M.; Vershynin, R. The Littlewood-Offord problem and invertibility of random matrices. 
Adv. Math. 218 (2008), no. 2, 600-633. 

Sankar, A.; Spielman, D.; Teng, S. H. Smoothed analysis of the condition numbers and growth 
factors of matrices. SIAM J. Matrix Anal. Appl. 28 (2006), no. 2, 446-476 (electronic). 
Tao, T.; Vu, V. On random ±1 matrices: singularity and determinant. Random Structures Algo- 
rithms 28 (2006), no. 1, 1-23. 

Inverse Littlewood-Offord theorems and the condition number of random discrete matrices. 

Ann. of Math. (2) 169 (2009), no. 2, 595-632. 

On the permanent of random Bernoulli matrices. Adv. Math. 220 (2009), no. 3, 657-669. 

Random matrices: the distribution of the smallest singular values. Geom. Funct. Anal. 20 

(2010), no. 1, 260-297. 

Smooth analysis of the condition number and the least singular value. Math. Comp. 79 (2010), 

no. 272, 2333-2352. 

Vershynin, R. Invertibility of symmetric random matrices. To appear in Random Structures and 



Algorithms. Preprint available at http : //arxiv . org/abs/1102 . 0300 2012. 



Institut de Mathematiques de Jussieu, Universite Pierre et Marie Curie, 4 Rue Jussieu, 
Paris, 75005, France 

E-mail address: friedland@math.jussieu.fr 

Department of Mathematical and Statistical Sciences, University of Alberta, Edmonton, 

AB T6G 2G1, Canada 

E-mail address: giladi(Sualberta. ca 



8 



